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ABSTRACT Re i a ii 0 nships between student affective and Cognitive 

learning outcomes and their perceptions of classroom environment as 
measured by the Classroom Environment Scale (CES) were investigated 
for a sample of 1,083 students i<n 116 science classrooms. It was 
found tha? CES scales displayed satisfactory internal consistency and 
discriminant validity, and that each CES scale differentiated 
significantly between the perceptions of students in different 
cilssrooms. Six different statistical analyses .(simple . correlation, 
multiple correlation, and canonical correlation analysis conducted 
separately for raw posttest scores and residual posttest scores 
adjusted for corresponding pretest ahd general ability ) were used to 
investigate environment-outcome relationships. The result's of these^ 
.different analyses taken together conf rmed the existence of sizable 
and statistically significant associations between student learning 
outcomes and their classroom environment perceptions as measured by 
the'CES In particular, greater levels of classroom Order and' * 
Organization! were -linked with greater student achievement of several 
outcomes. (Author) 
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Abstract 



Relationships between student affective and cognitive 
learning outcomes" and their 'perceptions of classroom environ- 
ment as measured by the Classroom Environment Sc^le (CES) 
were investigated for a sample of 1,083 students in 116 science 
classrooms. It wars 'found that CES scales displayed satisfactory ' 

I . 

internal consistency and discriminant validity, and that?, each 

' * I 

CES scale differentiated significantly "between the perceptions 

of student^ in different classrooms. Six different statistical 

• / ' 

analyses ^(simple correlation, multiple correlation, jand 

{ 

canonical correlation analysis conducted separately for raw 

- . 7 

posttest scores and residual posttest scores adjusted for 

■ - • / 

corresponding pretest and general ability) werefused to 
investigate environment-outcome relationships/ The results 
of these different analyses taken together confirmed the 
existence of sizable and statistically significant associations 
between student learning outcomes and their classroom environment 
perceptions as treasured by the CES. In particular, greater levels 
of classroom Order and Organizations Were linked with greater 
student achievement of several outcomes. 

3 " 
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Over the last decade or so, researchers in several- countries hayfc 
\ * 

shown increasing interest in the conceptualization, assessment, and 



investigation of a wide range of human milieus including family environments 
(Marjoribanks, 1979) ,' physical environments (Proshansky, IttleSon, & 
Rivlin, 1970), college environments (Stern, 1970), psychiatric treatment' 
environments (Moos, 1974$), and correctional and community environments 
(Moos, 1975). Evidence gleaned from*past studies strongly supports the • 
notion that the environment exerts considerable influence on human 
behavior and constitutes a ma^r determinant of effective functioning and 
satisfaction among milieu inhabitants* ' 

*This interest in a variety of human environments has been accompanied 
by considerable interest in the -study of the environments of school class- 
rooms. A common feature of much of this research is that classroom 
environment has ^een~as^ssed in»terms of 'student perceptions of psycho-^ 
social dimensions. Work on student perceptions of their- classroom $ 
environment has been summarized recently in a guest-edited journal issue 
(Fraser, 19j8a), several books (Fraser,' 1981a; Moos, 19*79^Walberg, 1979), 
and key literature reviews (Fraser, 1981b; Walberg, 1976;Walberg & 

Haertel' 1980). " Furthermg/e, the comprehensiveness of Frasdr and Walberg' s 

\ • '. \ 

(1981) recent review in Studies in Science Education reflects that class- 
room environment research currently is an,^ive field, of study among 
science education researchers. 

An overview of- previous research shows that the instrument used most 
frequently in studies of the environment of science classrooms has been 
the Learning Environment Inventory (Anderson & Walberg, . 1974) . In contrast , 
it appears, that the Classroom Environment Scale (CES) (Moos & Trickett, 1974) 
has had little or no prior use specifically in science classes. Because 
the CES has had so little use in science education, a secondary purpose of 



the present study 'was to explore the validity and usefulness of the CBS 

in science education specifically. ' 

The Strongest tradition in past. research has 4nvolved the Investigation 

of relationships betweelPthe nature of the classroom environment .and student 

achievement 'of valued ajyns in science education (Ha^rtel, Walberg, & 

Haertel, 1981 ) . The present research is consistent with this tradition as * 

It * provided the first use of the CES in science classrooms in studying 

associations between students 1 outcomes and their perceptions of classroom 

» 

■ • 

environment. 



4 



CLASSROOM ENVIRONMENT SCALE 
Initial Development 

Jtrumerlt 



One of the instruments used most extensively in prior classroom 
environment research is the Classroom Environment Scale (CES) (Moos & 
Trickett, 1974; Trickett & Moos, 1973), The CES was developed by , 




Rudolf Moos o.f Stanford University and grew out of a comprehensive research, 

program involving perceptual measures of a variety of human environments 

V v • 

including psychiatri\hospitals, prisons, university residences, and work 

milieus. Moos found that the same three general categories could be used 

»' v 

in concept uali#Lng the individual dimensions characterizing diverse psycho- 

~ f * • * 

social environments (Insel & Moos, 1974: Moos, 1974b). ' These three 

— • ■ . . ' i 

categories are Relationship Dimensions , which identify the nature and 
intensity of personal relationships within the environment and assess the 
extent to which people are involved in the environment and support and help 
each other, Personal Development Dimensions , which assess the basic 
directions along which pixsohal growth and self-ehhancement tend to occur, 
and System Maintenance and System Change, Dimensions which involve the extent 
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to which the environment is orderly, clear in expectations, .maintains 

» 

control, and is responsive to change. The development of the CES was 

based on the above conceptual framework for psychosocial environments, 

i . ' 

The, final version of the CES was developed after field testing and 

« 

modifying several preliminary versions* It consists of nine scales with 
10 items of True-False response format in eacl) scale (Moos & Trickett, 1974; 
Trickett & Moos, 1973). Table I clarifies the nature of the CES by listing 
the nam£ of each scale and its classification according toMOos's scheme, 
d by providing.a s^ale description and sample item for each sca]>e. 



Uses pf the CES in the U.S.A. have shown that each of its nine scales 
> 



differentiated significantly between classrooms' (Moos & Trickett, 1974), * ^ 
and have established relationships of classroom perceptions to student 
^satisfaction^ and moods (Trickett & Moos, 1974) and to stqdent absences^ and 
grades (Moos &Moos, 1978). Furthermore, Kaye, Trickett, and Quinlan (l$76) f 
have reported significant relationships among the various methods of assessing 
classroom environments, including student perceptions* (using the CES), 
ratings by outside observers , A and content analysis of teacher* student verbal\ 
interactions.. Also, using the CES, .revealing differences^ h^ye^ been found 
between types of classes classified according to Holland's scheme (realistic, 
investigative, social, conventional, enterprising, artistic) (Hearn & Moos, 1978), 



V 



r 



.6 \ 



Table 1. Descriptive Information fo 

—J. 



r Ea^ch Seal 



e of CES 



.Scale 
Name 



Moos f s 
General 
Category 



Scale Description 
Extent to which . . . 



Sample Item ' 4 



Invo Ivement Re la t ionsh ip 



students have attentive Students daydream a lot 



Affiliation Relationship 



vEeacher 
Support 



Relationship 



.interest, participate in 
discussions , do additional 
work, and enjoy thfe class. 

... students help each - 
other, get to know each 
other easily,; and enjoy 
working together. 

... the teacher helps, 
befriends , trusts, and is 
interested in students. 



in this class, 



(«?) 



Students in this class 
get to know each other 
really well . .(+) 



The teacher takes a 
personal interest in 
the students. (+) 



Task . 


Personal 


... it is important to 


The teacher oftet) takes 


- Orientation 


Development 


complete activities 


time out from the 






planned and to stay on^ 


lesson plan to talk 


- 


> . 


t&e subject matter. ' - 


about other things. (-) 


^CompetitiQn 


Personal < 


... students qompete with 


Some students always try 


Development 


each-otfier for grades and 


to see who can answer 






recognition , 


questions first. (+) 


Order and 


System 


*. . . there is "emphasis on 


Assignments are usuaLly 


. Organization 


'Maintenance & 


students behaving in an 


clear* so everyone knows 




System Change 


orderly, quiet, and polite , 


what to do, (+) 




• 


manner, and on the overall 


! 






organization of classroom 








activities. • 




Rule ' 


System 


... rules are clear, stu- 


There is a clear set 


Clarity 


Maintenance & 


dent's, know the consequence 


of rules for students 




System Change 


♦of breaking rules, and the 


'to follow. (+) 




/ 


teacher deals consistently 








with students who break 








ruLes. 




Teacher 


System 


... rules are enforced and 


Students don't always 


Control 


Maintenance & 


rule infractions are 


have to stick to the 




Sy st exchange 


punished . 


rules in this class •(-) 



Innovation 



System 

Maintenance & 
System Change 



... the teacher plans new, 
^mjsual^ and varying 
activities and techniques, 
and encourages students to 
contributes to classroom 
/planning and to think 
creatively. 



New and different ways 
or teaching are not 
tried very ofrtfen in 
this class. (-) 



pnjf^tems designated (+) were scored 3 and 1/ respectively, for the reisfkmses of True 
tJ\lL> md p a i se# items designated (-) were scored in t*je reverse" manner . Omitted or 



hnifliiiffnrrriaaii 



invalid responses were scored 2. 



and between classes in five different types of schools (urban, rural, 
suburban, vocational, alternative) (Trickett, 1978). 

, Validation with Present Sample t 
The present study involved administration of the CES to a representative 
sample of 116 grade 8 and 9 science classes, each with a different teacher, 
in 33 schools in Tasmania, Australia. Schools were located in both suburban 
and country areas and approximately equal numbers of boys and girls made up 
the sample. As only a random half of e^ch class responded to the CES (while 
the rest of the class simultaneously answered other questionnaires for another 
purpose?), the total iyJmbit* of students in the sample was 1,083. Since the 
intact class and not the individual student was the primary sampling unit, it 
was decided to*employ the class mean as the unit of statistical analysis 

throughout the study (see Ross, 1978). The advantage of using the class mean v 

/ 

in this context is that it satisfies the requirement of independence of 
observations. ^ 

Because very little information is available elsewhere about the 
reliability and validity of the CES when used with a sample of science 
classes, Table II reports some validation data for the sample of 116 
Australian classes. Thes.e data include estimates of each scale's internal 
consistency reliability (alpha coefficient) and discriminant validity (mean 
magnitude of the correlation of a scale with the other eight scales) when 
the class mean was used as the unit of analysis. Class reliabilities were 
calculated simply by using the variance of class means in conjunction with 
the conventional alpha formula. t \ 



Table II. Internal Consistency (Alpha Coefficient) and Discriminant Validity (Mean 
Correlation with other Eight Scales) for Class Means, and ANOVA Results 
(F and Eta 2 ) for Class Membership Differences for each CES % Scale 





Scate Validation 


Statistics" ' 


ANOVA Results 


Scale 


' Algjia 
Reliability 


Mean 
with 


Correlation 
Other Scales 


F 


Eta 2 - 


Involvement 


0.81 




0.42 


** 

3.38 


* 

0.29 


Affiliation 


0.71 




0.29 


' , *# 
' 2.17 


0.21 ' 


Teacher Support 


0.85 




0.38 


** 

A. 40 


0.34 


Task Orientation 


0.72- 




0.31 


it* 
2.81 


0 ..25 


a 

Competition 


0.60 . 




0 .08 


1.37 


0.18 


Order & Organization 


0.90 




0.40 


*# 

6.27 


0.43 


Rule Clarity 


0.76 , 




0.$6 


** 
2.21' 


0.21 


Teacher Control 


,0.71 


> 


0.23 * 


VWr 

3.07 


0.27 


Innovation 


0.71 




0.29 


** 

2.97 


0.26 



£<.0l 

2 f 
•Eta is th^ ratio of between to total sums of squares and indicates the proportion of 

variance, explained by class membership 

Reliabilities and mean correlations are based on a sample of 116 class means. ANOVA results 

are for 1,083 students in the 116 classes , K 

*Data are based on scales containing 10 items except for Competition (8 items) and Innovation (9 items) ♦ 




-Data in Table II indicate that scale reliability estimates ranged from 
,0.6p to 0.90, thus indicating satisfactory internal consistency on each CES 
scale when using" classes as the units of analysis. Tabl^JX-atso^shows that 
the value of the mean correlation of a scale witl_th£ othej scales ranged 
from 0.08 to 0.42, thus suggesting that the CES measures distinct although 
somewhat overlapping dimensions of classroom environment. Moreover, these 
data for the Australian sample compare favorably with those reported f ojp a 
. sample in the U.S.A. (Moos & Trickett, 1974), where internal consistekyJ^L^- 
estimates ranged from 0.67 to 0.86 for a sample of 22 classes and mean 
correlations of a scale with the other scales ranged from 0.18 to 0.37 for a , 
sample of 465 individual students. 

A desirable characteristic of any classroom environment scale is that it 
is capable of differentiating between, the perceptions of students in different 
classrooms. That is, students within ^ie same class should perceive it 
relatively similarly) while mean withirf-class perception/ should vary from • 
classroom to classroom. This characteristic was explored for each CES scale 
with the present sample by performing a one-way ANOVA\with class membership 
as the main effect and using^the individual as the unit of analysis, to obtain 
information about the ratio of between-class variance to within-class variance. 
The results of these analyses are included in Table II and indicate that each 

CES scale differentiated significantly ( £ < .01) between the perceptions of 

2 

• students, in different classrooms. Furthermore, the eta statistic, which is 
the ratio of between to total sums of squares (Cohen & Cohen, 1975), was 
calculated as an estimate of the amount of variance in CES scores attributable 
to class membership. Table II shows that the proportion of variance accounted 

_for by class membership, ranged from 0.18 for the Competition scale to 0.43 for ' 
the Order and Organization scale. 

\ 
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RELATION OF CLASSROOM ENVIRONMENT TO STUDENT OUTCOMES 

Prior Research 

Prior research into associations between student outcomes and classroom 
environment perceptions exhibits many methodological variations in terms of 
choice of types of student outcomes, units of statistical analysis, methods of 
data analysis, and control for student background variables (see reviews of 
Fraser, 1981a; Haertel, Walberg, & Haertel, 1981). In particular, the three 
main methods of analysis commonly used have been a simple correlational 
analysis of relationships between individual outcome measures and individual 
environment scales, a multiple regression analysis of relationships between 
each outcome measure and the set of environment scales as a whole, and a 
canonical analysis of relationships between the set of outcomes and the set 
of environment scale^. Another important methodological way in which prior 
"Studies differ is in terms of whether student background characteristics 
(particularly corresponding pretest outcome performance and general ability) 
were controlled statistically when estimating the strength of outcome- 
environment^felationships . 

It is interesting to review prior predictive validity studies specifically 
involving the use of the CES in order 4 to summarize their conclusions and to 
highlight their methodological attributes. Trickett and Moos (1974) used the 
CES to explore relationships between student perceptions # and their satisfactions 
and moods among a sample of 608 students in the U.S.A. in two matched groups 
of 18 classes from 18 different high schools ♦ When simple correlations between 
CES and raw criterion scores were calculated separately for the two matched 
groups using the class as the unit of analysis, the number of statistically 
significant correlations .was six times that expected by chance. In another 
study involving a sample of 19 high school classes in one school in the U.S.A., 
Moos and Moos (1978) used the CES to investigate associations between environ- 
Y-rJ^^ ment perceptions, and student absences and grades, A simple correlational 



analysis using the class mean as the -unit of analysis revealed that* the 
number of significant relationships between #m outcome and one of the nine 
environment scales was five for the criterion of glides and two" for the 
Criterion of absents. In contrast to these two studies involving simple \ 

y > . . 5 < 

correlational analyses of data collected from samples of limited size, Moos 
(1979) has reported a more comprehensive and stringent investigation of , 
environment- outcome relationships involving the use of multiple regression 
.techniques with data from a sample of 241 classes. The outcomes consisted of 
five indexes of student* reactions (f riendship^f ormati.on, sense of well-being, 
satisfaction with learning, satisfaction with teachers, alienation), and 
outcome-environment relationships were estimated after removing the variance 
in outcomes attributable to five other 'domains of predictors (e.g., student 
characteristics and teacher characteristics). Specific findings included 
that a block of classroom environment variables (based on cluster analysis of 
CES scores) ^iqtlely explained half of the predictable variance in^Sstudent 
satisfaction. with the teacher, and that students in supportive task oriented 
and supportive competition oriented classes showed the most positive reactions 
on the outcome criteria (including satisfaction with learning). 

Although the CES has been used to a limited degree in previous research 
on the effects of psychosocial characteristics of the classroom environment 
on student learning outcomes,^ there has been a sizable number of studies 
using alternative instruments. -These include the use 'of the Learning 
Environment Inventory in studies in the U.S&. (Lawren?, 1976; Walberg, 1972)-,, 
Canada (O'Reilly, x 1975; Walberg & Anderson, 1972) , Australia (Fraser, 1979; 
Power & Tisher,. 1979), .Israel (Hof stein,- Gluzman, Ben-Zvi,, & "Samuel, 1979), _ 
and India (Walberg, Singh, & Rasher, 1977), the use of the My Class Inventory 
in the U.S.A. (Talmage & Walberg, 1978) and Australia (Fisher & Fraser, 1981), ' 
and the use of the Individualized Classroom Environment Questionnaire in 
Australia (Rentoul & Fraser, 1980). Taken together,, prior research- results 



1 O 



provide convincing and consistent evidence that students' classroom environ- 
ment perceptions account for appreciable amounts of variance in learning 

outcomes, often beyond that attributable to student characteristics such as 

> 

pretest performance, general ability, or both (see Anderson & Walberg, 1974; 
Fraser, 1981a; Walberg & Haertel, 1980). 'Moreover, this pattern is further 
highlighted in the 'resists of Haertel, Walberg, and Haertel's (1981) recent 
'meta-analysis involvin^/734 correlations obtained from 12 studies of 10 data 
sets in eight subject areas, encompassing 17,805 students in 823 classes in 
four nations. This research synthesis revealed strong and consistent 
associations between student cognitive and affective outcomes and their 
perceptions of classroom environment. 



ERLC 



Design of Present Study 



/ 



« In oilier 'to permit investigation of relationships between classroom 

environment perceptions and learning outcomes. in the present study, three 

cognitive and six affective measures were administered both at the beginning 

and end of the same school year. The three cognitive outcomes were measured 

by the Test of Enquiry Skills (Fraser, 1979b) atid consisted of ten-item, 

multiple choice scales called Comprehension of Science Reading, Design of 

Experimental Procedures, and Conclusions and Generalizations. "The KR-20 

reliability figures for class means were found to be 0.81, 0.75, and 0.77, 

respectively, for the present sample of 116 classes. The six attitude measures 

each consisted of ten items of Likert format and were selected from the Test of 

Science-Related Attitudes (Fraser, 1981c). These scales are called Attitude . 
> 

to the Social Implications of Science, Enjoyment of Science Lessons, Attitude 
to the Normality of Scientists (i.e., the extent to which students view 
scientists as normal people rather than as the eccentrics sometimes depicted 
in the mass media), Attitude to Inquiry, Adoption of Scientific Attitudes 
(e.g., curiosity, open-mindedness) , and Leisure Interest in Science. 



Class alpha reliabilities were found to range from 0.80 to 0.97 for these 
six attitude scales.* In addition to^these cognitive and affective measures, 
information was gathered about the general ability of the ^CmfentS using a 

4 

version of the' Otis test.' * A 

The present study involved- the use of the class mean as the unit of 
statistical analysis. AJej> t . in order to permit easier comparison of the 

> * 

results of this study with prior research, .data were analyzed in six different 

ways which reflect major methodological variations in past research. These 

six methods - namely a simple, multiple, and canonical correlational analysis 

involving raw scores and a simple, multiple, and canonical correlational 

analysis involving -residual scores - are discussed and clarified below. 

It has been common in prior research to perform a conservative test of 

outcome-environment relationships by controlling statistically certain student 

characteristics, especially corresponding, pretest. and general ability. That 

is, for reasons of simplicity, leatning environment dimensions have been , 

considered useful predictors of student learning outcomes only if they 

accounted for different variance from that attributable to well-established 

predictors like pretest 1 and general ability. While conservative analyses in 

which student characteristics are controlled have the merit that they do not - 

overestimate the variance component attributable to environment, they might 

f 

well underestimate the" importance of the environment component because any 
variance shared by environment and student characteristics is removed. For 
this reason, all analyses (simple, multiple, canonical correlation) were 
performed twice, once using raw posttest scores as the criterion variables 
and once using residual posttest scores adjusted for' corresponding pretest 

and general ability.. 

Table III shows the results of the six types of analyses.. The first 
pair of analyses shown in this table are the least complex as- they involve 
Simple correlations between class means on the nine CES scales and class means 
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on the set of nine outcome posttests (using either raw scores or residual 

' 

scores adjusted for corresponding pretest and general ability). A major 

advantage of these simple correlational analyses is that they furnish data to 

other workers interested in associations between particular environment 

variables and particular outcomes. For example, future workers Wanting to 

conduct meta-analyses involving specific environment or outcome variables 

i 

would require this sort of data. The results in T^ble III shqp that the 

number of significant outcome-environment correlations (j><.05) was 27 for 

the analysi/ iW»lving raw posttest scores (i.e., about s^ven tim^s that 

expected by chance), and 18 for the analysis using resi'dual posttest scores 

(about four times that expected by chance). Furthermore, inspection of the 

signs of the correlations* in Table III show that all significant outcome- - 

environment relationships were positive except for three cases in which f 

greater levels of perceived Innovation were associated with lower raw outcome 

» 

scores (Attitude to the Normality of Scientists, Design of Experimental 
Procedures, and Conclusions and Generalizations). 

i * 1 

The second pair of analyses reported in Table III consisted of a multiple 
correlation analysis involving the 4 set of nine CES scales, and performed 
separately" for each outcome using ^either raw or residual criterion scores. 
The multiple correlation provides a more parsimpnious picture of the joint 
influence' of correlated environment dimensions on outcomes, and reduces the 
Type T error rate associated with "simple correlational analysis. These 
analyses should be of particular relevance to people interested in specific 
outcome measures. Table III shows that the multiple correlation between raw 
outcome scores and the set of * classroom environment scales ranged from 0*30 
to 0.51 and was significantly greater than zero (£<.05) for seven of the 



Table III. Simple, Multiple, and Canonical Correlations Between Classroom Environment Dimensions and Lear ^ n 8 Outcomes 
(Using Raw Outcome 'saorea and Residual Scores Adjusted for Corresponding Pretest and General Ability) 







• 






Simple Correlation 












' Learning 
Outcome 

i 


Raw Scores/ 

n _ _ < j... i «a 
tvesiouaia 




A 
















Multiple 


Beta Weights for Significant b * 


.In vol 


Affil 


Tea«ch 
Supp 


Task 
Orien 


Corap 


- Order 
& Org 


Rule 
Clar 


Contr 


Innov 


Correlation 


Individual Environment Predictors 


Social Implications 
of Science 


Raw Scores 
Residuals 


* 

.27 


.24 * 


.16 
.15 


.25' 


.20 
.14 


** 

..33 


it 

.26 . , 


.02 

.03 


..06 
.09 


* 

.39 


.34* (Order & Org) 

.36 (Order & Org) ^ 


Enjoyment of Science 
Lessons 


Raw Scores 
Residuals 


** 

.36 


★ 

• 20 * 

.27 


** 

.27 

M6 


.22 


.13 
.02 


** 

.40 


** 

•"* 

.20 % 


■ - .U2 

.05 


★ 

.03 


** 

.44 


43**» (Order & Or*) 
.38 (Order & Org) * 


Attitude to Normality 
' of Scientists » ' . 


Raw Scores 
Residuals 


.12 


.11 . 


• U/ 
.15 


.23* 
.07 


.03 
-.04 


.16 
.10 


.10 
.18 


.08 
.08 


.*-.»* 


★ 

.39 
.31 


.37* peach Syrffi -.37** (Innov) 
.25* ^Kule Clar) * 

* Jr 


^Attitude to Inquiry 


Raw Scores 
Residuals . 


. -11 
.10 


.18 
.18 


.05 
.04 


.*18 
,13 


.07 
.05 


.10 
.09 


* 

.23 


.07 
.09 


.03 
.01 


- * 
< .38 
.29 


Adoption of Scientific 
Attitudes 


Raw Scores 
Residuals 


.07 
.16 


** 

.26~ 


• 10 * 
-.21 


** 

.25 
.07 


.14 
-.01 


.17* 
.18* 


.06 
' .15 


-.04 
-.02 


-.13 
.06 


** 

" 3 ^V / 


Al* (Affil); -.26* (Innov) 
.23 (Affil) N * 


* 

Leisure Interest in 
Science' 


Raw Scores 
Residuals 


** 
.30 , 


★ 

.22 
.12 


.11 * 
.11 


** 

.25 

-u 


.08 

-fit 


** 

> 


** 

.21 


.04 
.00 


★ 

■2°* 

.23 


.49/ 


" 56 ** (° rder & 0r sb ^ Innov ) 
.45 (Order & Org); .32 ftnnov) 


Comprehension of 
Science Reading 


Raw Scores 
Residuals 


1 .02 
.11 


.13 
.13 


-.03 
• .00 


.15 
.03 


.05 
.03 


.13 
.17 


-.05 
.06 


-.04* 
.06 


-.13 
.01 


Ao - 

/.27 


4 


Design of Experimental 
Procedures 


Raw Scares 
Residuals 


-.08 
-.05 


.03 
-.05 


-.06 
-.02 


.22 
-.05 


.18 
.09 


.11 

.05 


.01 
.09 


.05 
.12 


* 

-.05 


/ " 37 
/ .28 




Conclusions and ' 
Generalizations 


Raw Scores 
Residuals 


,08 
.18 

% 


.17 
.12 


.06 

.07 
^ 


** 
.31 

.14 


.15- 
.07 


■* 
.22 

** 

.26 


-.02 
.07 


.04 
.12 


* 

-.20 
-.02 / 


/ .47?fv ( 
(• 

.38 - ■ 


.35* (Teach Supp); .27* (Task Orien) 
-.28^ (Innov) 
135 (Order & Org) 



Canonical Correlations 



Raw Scores 
Residuals 



** * 
.67 , .54^ 
.62 



£ <.05, £<.01 



Residual scores have been adjusted for performance on the ^responding pretest and general ability. .* 

b Beta weights are shown for those individual predictors for which, t\t % the corresponding block of nine environment scales had a significant multiple 
correlation and, secon^ the b weight was significantly different from zero. 
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nine' outcomes . Aa expected, multiple correlations were smaller for analyses 

involving residual scores, with values ranging from 0.27 to 0.49 and with 

four of these being statistically significant. L 

In order to. interpret which individual CES scales were jnaking the largest 

contribution to explaining variance in learning outcomes , an examination was 

made of b and beta weights for those regression equations for which the 

multiple correlation for the whale block of ninef environment scales had been 

found to be significantly greater than zero (£<.05). The right hand ^side 

* of Table III li^fcs the magnitude of the beta weight for "those individual 

environment scales whose b weight was significantly different from zero •(£< .05) 

and for which the corresponding^ lock of environment scales also had a signifi- 

cant multiple correlation. This table shows that a number of significant 

relationships for individual environment variables was 11 when raw criterion* 

scores were used and was 5 when residual criterion scores were used. 

The signs of the heta weights in Table III can be used to suggest the 

^ following interpretations for the 11 significant individual outcome-environment 

relationship* using raw postte^t scores: Social Implications of Science 

scores were higher in classes perceived as having greater Order and J 

Organization; Enjoyment of Science lessons scores were higher in classes 

perceived as having greater Order jftid Organization; Attitude to the 

Normality of Scientists scores were higher in classes perceived as having 

greater Teacher Support and less Innovation; Adoption. of Scientific Attitude 

' scores were higher in classes perceived as having greater *Af filiation and -less 

• ■ * N 
Innovation; Leisure Interest in Science scores were higher in' classes perceived. ' 

as having greater*, Order and Organization and Innovation-; and Conclusions and 

Generalizations scores were higher in classes perceived as having greater 

Teacher 'Support, greater Task .Orientation, and less Innovation.. Examination 

• of the signs, of the beta weights for residual scores in Table III suggests 

the following interpretations of significant outcome-environment relationships 



when corresponding pretest and general ability were controlled: , greater 
levels of. perceived Order and Organization in the classroom were associated 
with higher scares on Social Implications. of Science, Enjoyment of Science 
Lessons. Ileisure Interest in Science, and Conclusions and Generalizations; 
and greater levels of perceived Innovation were associated with higher 
Leisure Interest in Science scores. / 

Although the use of the multiple correlation analysies overcomes the . 
problems, of collineartty between CES scales, collinearity between outcome 
measures could still give rise to an inflated experimcyitwise Type I error rate. 
Canonical analysis, howeVer, can provide a parsimonious picture of relation- 
ships between a domain of correlated learning outcomes and a domain of 

* ' . r 

correlated environment dimensions. Consequently, two canonical analyses were 

71 

conducted using the ciass mean as the unit of analysis. Whereas the first 
canonical analysis explored relationships between scores on the set of nine 

# ^ environment scales and raw posttest scores on the set of nine learning , / 
outcomes, the second canonical analysis explored relationships between scores 
on the set of nine environment scales and residual posttest scores on the nine 
"learning outcpmes. The bottom of Table III shows that both canonical analyses 
yield^cl at least one significant canonical correlation. Two significant 
canonical correlations of 0 .67 (£<.0l) and 0.54 (£<.05), respectively, were 
found between environment scales and raw/ posttest scores, while one significant . 
canonical correlation of 0.62 (p_< .01) was found between environment scales 

~r" and residual post'test' scores . . , 

In order" to 'interpret the re<rfllfts .of the canonical analyses, an examination 

> * t 

was made h't the magnitudes and signs of canonical loadings associated 'with each 

significant canonical variate. The interpretation of the first significant 

canonical correlation for the analysis involving raw scores*was readily 

iqterpffc table . It indicated that attitude scores- on the Enjoyment of Science 

Lessons andXe^ure Interest in Science scales were higher in classes perceived 
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as having greater Order and Organization and Innovation. The interpretation 

of the second significant canonical correlation for the analysis of raw t 

scores was less straightforward, but it suggested that cognitive outcome 

.scores on the Conclusions and Generalizations scale tended to be higher in 

classes perceived as having more Teacher Support and less Innovation. These 

interesting but tentative results for -the two canonical variates for the 

present sample suggest that classroon* Innovation tended to enhance attitudinal 

1 * ♦ 

outcomes but to impede cognitive outcomes. The straightforward interpretation 

v of the significant canonical- correlation for residual scores was that, with 

corresponding pretest scores and general ability controlled, Leisure Interest 

in Science scores were greater in classrooms perceived as having greater 

Order and Organization. * 

r 

CONCLUSION 

This paper has described a study of relationships between students' 

learning outcomes and their perceptions of classroom environment as measured 

by the Classroom Environment Scale (CES) among a large sample of 1,083 students 

in 116 classrooms. JLt was found that', for this sample, CES scales displayed 

satisfactory internal consistency and .discriminant validity, an'<f that each 

scale differentiated significantly between the perceptions of students in 

different classrooms. Relationships between a set of nine learning outcomes 

(six affective and three cognitive) and the set of nine classroom environment 

scales contained in the CES were explored usixjg the class mean as the unit 

of analysis and six different data analytic techniques. Three of theSe were 

a simple correlational analysis between raw^scores on outcome posttests and 

CES scales, a multiple correlational analysis involving the prediction of 

♦ 

raw scores on each outcome posttest from the set .of nine CES scales, and a 

canonical analysis involving the set of nine CES variables and raw scores 

on the set of nine outcome posttests. The other three analyses were analogous 
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to these and consisted of simple, multiple, and canonical analyses involving 
the set online CES scales and residual scores on the set of nine outcome 
posttests (adjusted for corresponding pretest and general ability). Taken 
together, the six different analyses confirmed the existence of sizable and 
statistically significant associations between students' learning outcomes 
and their classroom environment perceptions as measured by the CES. 
f The general finding of the existence of significant environment- 

outcome relationships which emerged from the present use of the CES 
replicates many prior science education studies (see review of Fraser & 
Walberg, 1981) whSh have established appreciable relationships between 
classroom environment and student outcomes" in studies involving a 
variety of instruments in numerous different countries. Furthermore, 
it is possible to compare the present specific findings with those of 
Haertel, Walberg and Haertel's (1981) recent meta-analysis of 12 past 
studies which, although not involving use of the CES specifically, 
involved several scales analogous in meaning to some of the CES's scales. 

< 

In particular, the present results indicating that student outcomes were 
enhanced, in classes with greater Affiliation, Task Orientation, and 
Order and Organization replicate some of the findings emerging from this 
meta-analysis. Also, it is noteworthy that the proportion of significant 
correlations, emerging between affective, outcomes and classroom environment 
variables classifiable as Relationship dimensions (i.e., Involvement, 
Affiliation, and Teacher Support) was greater than the proportion of 
significant correlations elsewhere in the outcome-environment correlation 
matrix (see Table III). This pattern of results is consistent with 
Moos' s (1979) general contention that Relationship dimensions influence 
attitudes, and supports the general usefulness of Moos's (1974b) scheme for 
classifying the types of dimensions characterizing. human environments. 
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Because of the correlational nature of the present study and most prior 

* r 

research, caution should be exercised in assuming that the nature of the 
classroom environment "caused" student outcomes. Admittedly the fact that 
the present results replicate prior research increases confidence in the 
findings, and tjie use of residual scores (adjusted for corresponding pretest 

and general ability) rules out the major rival hypothesis that observed 

f 

outcomes could be attributed to differences in student background 
characteristics found in classes with different environments* Consequently, 
a desirable direction for future research would be to conduct controlled 
intervention studies in which the nature of classroom environments are 
deliberately manipulated in order to permit investigation df whether 
changing classrooms in specified directions does result in hypothesized 
improvements in students' attitudes and achievements. 

One practical implication emerging from this study is that researchers 
and teachers can have greater confidence in using the CES. The present 
study showed that the CES scales displayed satisfactory reliability when 
used for th& first time specifically in science classes. Also the 
establishment of empirical links betvjgen desired student outcomes and 
classroom environment characteristics has practical implications about 
ways in which scien^e^eachers might change their classrooms to improve 
student attitudes and achievements. In particular, the present study 
suggests that emphasis on classroom Order and Organization is likely to 
have a positive influence on student achievement of a wide variety of 
different aims. It is hoped that science educators will make use of the 
CES for a variety of worthwhile purposes including monitoring and evaluating 

if 

curriculum innovations (Fraser, 1981a), investigating differences between 
science students and teachers in their perceptions of actual and preferred 



classroom environment (Fisher & Fraser, in press), exploring whether 
students achieve better whe£ in their preferred classroom environment 
(Fraser & Fisher, in pre&s), and attempting to use student perceptions 
as a practical basis for guiding environmental change (Fraser, 1981d). 
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